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(S) Apparatus and method for processing image data. 

@ Image processing apparatus is described in 
which a source stream of data captured by a 
particular source (2, 6, 16, 10) is passed through 
a data splitter (20) where it is split using one 
splitting technique into a plurality of split 
streams of data. These split streams of data 
each contain only part of the information within 
the source stream of data. The split streams of 
data are separately manipulated by a post pro- 
duction unit (24) prior to being passed through 
a data combiner (28) where they are recom- 
bined to form an output stream of data. The 
source stream of data and the output stream of 
data are of a higher resolution than the indivi- 
dual split streams of data. The post production 
unit includes at least one reformatter (96, 100) 
for reformatting the data stream to use a diffe- 
rent splitting technique matched to the manipu- 
lation being performed in the post production 
unit. 
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This invention relates to the processing of image 
data. 

The processing of image data is a well establish- 
ed technical field. Image data can be captured in 
many different forms. For example, image data may 
be captured by still/moving image photographic cam- 
eras or still/moving image electronic cameras. Once 
the image data has been captured, it is typically trans- 
formed into a stream of data according to a known im- 
age data format, such as PAL, NTSC, SECAM or 
SMPTE 240M. 

There exist many different pieces of equipment 
for performing manipulations upon image data in the 
aforementioned formats. The manipulations can take 
many different forms. For example, the manipulation 
may be recording onto magnetic tape, processing 
through a digital video effects system, motion com- 
pensated standards conversion or spatial filtering. 

As the technical field of the capture, manipulation 
and reproduction of image data has advanced, this 
has made possible the use of increasingly high reso- 
lution systems. At the present time this technical field 
is at the start of a transitional period between the use 
of formats such as PAL, NTSC and SECAM and the 
use of a new generation of high definition of video for- 
mats. 

A major obstacle that stands in the way of such 
evolution is the vast amount of investment and devel- 
opment effort that must be expended to produce ap- 
paratus for manipulating data in these new higher re- 
solution formats. As spatial and temporal resolution 
increases the rate at which image data must be han- 
dled increases to an extent that the sophistication of 
the equipment used must be significantly increased 
so as to cope. This is a hugely expensive undertaking. 

One possible way in which the use of higher re- 
solution formats may be facilitated is to split the 
source stream of data into a number of separate split 
streams of data each having only part of the informa- 
tion content of the source stream of data. The lower- 
ing of the information content of the split streams of 
data may be sufficient to allow existing or slightly 
modified equipment, originally designed for use with 
lower resolution formats, to be employed. This tech- 
nique can be thought of as providing a hierarchial phi- 
losophy in which systems of increased resolution can 
be built from combining pieces of equipment that were 
originally produced for lower resolution operation. 

Whilst the above is a superficially attractive ap- 
proach, it brings with it its own set of problems which 
must be solved if its use is to be practical. In particular, 
the splitting, manipulation and combining of the data 
can introduce distortions into the image data that did 
not occur, or were not relevant, when the lower reso- 
lution equipment was being used upon data in the for- 
mat for which it was originally intended. 

The invention provides apparatus for processing 
image data, said apparatus comprising: 



an image data source for generating a source 
stream of data representing an image; 

a data splitter for splitting said source stream 
of data into a plurality of split streams of data each 
5 representing a part of the information content of said 
source stream of data; 

manipulation means for performing a manipu- 
lation upon said plurality of split streams of data; and 

a data combiner for combining said plurality of 
10 split streams of data into an output stream of data; 
wherein 

said manipulation means includes at least one 
refor matter for reformatting said plurality of split 
streams of data such that the information content of 

15 said source stream of data is split between said plur- 
ality of split streams according to a different technique 
that is matched to a manipulation to be applied to said 
plurality of split data streams. 

The invention both recognizes and solves the 

20 problem that differing ways of splitting the image data 
are suited to some, but not other, forms of manipula- 
tion prior to recombination. The provision of a system 
in which the manipulation means includes at least one 
reformatter greatly increases the versatility of the 

25 system whilst only incurring a minor increase in com- 
plexity. 

It will be appreciated that the data splitter and 
data combiner may use many different splitting tech- 
niques. An 'ad hoc' approach could be used to pro- 

30 vide whatever interfaces were needed between dif- 
ferent items of manipulation apparatus so as to 
change the data splitting format. This would however 
cause problems by preventing a uniform approach to 
monitoring the signal at different points along the 

35 processing chain. 

A better approach is to provide a uniform format 
for the exchange of data between manipulation appa- 
ratus and then provide each manipulating apparatus 
requiring other than this uniform format with refor- 

40 matters at its input and output to reformat out of and 
then back in to the uniform format. The differing split- 
ting techniques that may be used each have associ- 
ated advantages and disadvantages. Splitting the 
data by sub sampling is simple to implement, but the 

45 monitor signals are generally not of high quality. Split- 
ting the data by tiling is still relatively easy to imple- 
ment and has the advantage that standard conceal- 
ment of errors can be used, but has the disadvantage 
that monitoring is not that straight forward and edge 

so effects may be visible upon recombination. 

In preferred embodiments of the invention said 
data splitter includes means for splitting said source 
stream of data i nto a plural ity of streams of two d imen- 
sional spatial frequency sub band data and said data 

55 combiner includes means for combining said plurality 
of streams of two dimensional spatial frequency sub 
band data to form said output stream of data. Splitting 
the data on a spatial frequency basis can be achieved 
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by using relatively simple and inexpensive filters. Fur- 
thermore, since each sub band has its edge corre- 
sponding to the edge of the full image, this approach 
is not prone to introducing edge effect errors into the 
central part of the reconstructed image. 

The sub band splitting technique is particularly 
suitable when said manipulation means includes an 
image data recorder for separately recording said 
plurality of streams of two dimensional spatial fre- 
quency sub band data and monitor means for repro- 
ducing a monitor image during partial replay from that 
stream of two dimensional sub band data having the 
lowest two dimensional spatial frequencies. The mon- 
itoring of the image is of critical importance when car- 
rying out tasks such as editing with manipulations 
from a digital video effects unit and this feature allows 
one of the recorded channels to be used to provide a 
good quality monitor image. 

In particularly preferred embodiments of the in- 
vention said data splitter is operable to provide that 
stream of two dimensional sub band data having the 
lowest two dimensional spatial frequencies with a sig- 
nal format suitable for direct reproduction by a televi- 
sion receiver. This feature allows the sub band data 
having the lowest two-dimensional spatial frequen- 
cies to be directly tapped and displayed upon a con- 
ventional television receiver. This monitor image will 
be of a lower resolution than the source stream of 
data, but it is quite sufficient for the function of locat- 
ing particular points within an image data stream. 

Whilst sub band splitting has advantages in cir- 
cumstances such as those described above, it suffers 
from the limitation that any manipulation that alters 
the spatial frequency of any of the data in the split 
streams of data would introduce a gross distortion on 
recombination. Furthermore, any manipulation in- 
volving spatial filtering would have a disadvanta- 
geous^ decreased resolution due to the decreased 
spatial resolution of the individual split streams of 
data upon which it would operate. 

Accordingly, in preferred embodiments of the in- 
vention said at least one reformatter includes means 
for reformatting said plurality of split streams of data 
into a plurality of streams of data each representing 
a different area within an image. 

This reformatting recovers the full spatial resolu- 
tion within each of the split streams of data that may 
be required for the manipulation concerned. Embodi- 
ments of the invention with a reformatter capable of 
providing tiled data are particularly suitable when said 
manipulation means includes a spatial filtering means 
for performing spatial filtering separately upon said 
plurality of streams of data representing different 
areas of an image. 

Another reformatting operation is provided by 
embodiments in which said at least one reformatter 
includes means for reformatting said plurality of split 
streams of data into a plurality of streams of sub sam- 
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pled data. Such splitting prior to manipulation helps 
avoid edge effects in the centre of the picture and is 
not subject to the rigid requirement that the spatial 
5 frequency of the split streams of data must not be al- 
tered. 

If it is desired that the manipulations should be 
carried out in real time, then one class of preferred 
embodiments provide that said manipulation means 
10 has a multichannel architecture with said plurality of 
split streams of data each being manipulated in a dif- 
ferent channel so as to provide real time manipulation 
of said image data. 

Alternatively, if real time operation is not required, 
15 then preferred hardware efficient embodiments of 
the invention are such that said data splitter outputs 
a multiplexed stream of data comprising a sequence 
of contemporaneous portions of said plurality of split 
streams of data, said manipulation means performing 
20 non real time manipulation upon said multiplexed 
stream of data. 

The invention also provides a method of process- 
ing image data, said method comprising the steps of: 
generating a source stream of data represent- 
25 ing an image; 

splitting said source stream of data into a plur- 
ality of split streams of data each representing a part 
of the information content of said source stream of 
data; 

30 reformatting said plurality of split streams of 

data such that the information content of said source 
stream of data is split between said plurality of split 
streams of data according to a different technique 
that is matched to a subsequent manipulation ; 
35 performing a manipulation upon said plurality 

of split streams of data; and 

combining said plurality of split streams of data 
into an output stream of data. 

An embodiment of the invention will now be de- 
40 scribed, byway of example only, with reference to the 
accompanying drawings in which: 

Figure 1 illustrates a non real time system for ma- 
nipulating image data with equipment originally 
designed for manipulating image data of a lower 
45 information content; 

Figure 2 illustrates a real time system for manip- 
ulating image data with equipment originally de- 
signed for manipulating image data of a lower in- 
formation content; 
so Figures 3 and 4 illustrate a sub band splitting 

technique; 

Figure 5 illustrates a data splitter for use with the 
sub band splitting technique; 
Figure 6 illustrates a data combiner for use with 
55 the sub band splitting technique; 

Figures 7 and 8 illustrate a tiling splitting techni- 
que; 

Figure 9 illustrates a data splitter for use with the 
tiling splitting technique or a sub sampling split- 
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ting technique; 

Figure 10 illustrates a data combiner for use with 
the tiling or sub sampling splitting techniques; 
Figures 11 and 12 illustrate the sub sampling 
splitting technique; 

Figure 13 illustrates a manipulation means with 
reformatters; 

Figure 14 illustrates non real time monitoring of a 
data stream split with the sub band technique; 
Figure 15 illustrates a real time monitoring of a 
data stream split with the sub band technique; 
Figure 16 illustrates non real time monitoring of a 
data stream split with the tiling splitting techni- 
que; 

Figure 17 illustrates a real time monitoring of a 
data stream split with the tiling splitting techni- 
que; 

Figure 18 illustrates non real time monitoring of a 
data stream split with the sub sampling splitting 
technique; 

Figure 19 illustrates a real time monitoring of a 
data stream split with the sub sampling splitting 
technique; and 

Figures 20, 21 and 22 illustrate example picture 
manipulations. 

Figure 1 illustrates a system for the non real time 
manipulation of image data. Various apparatus for 
generating the source stream of image data is illu- 
strated. These include: a still image photographic 
camera 2 and a slide converter 4; a movie camera 6 
and a film scanner 8; a high definition moving image 
electronic camera 10, a high definition digital video 
tape recorder 12 and a video data mixer 14; and a su- 
per high resolution moving image electronic video 
camera 16 and a super high resolution digital video 
tape recorder 1 8 (illustrating the hierarchial manner in 
which the system can cope with increased resolution 
equipment developed in the future). 

The image capture of these devices takes place 
in real time. Subsequent processing in this embodi- 
ment takes place in non real time. The factor by which 
the processing time is reduced is approximately equal 
to the number of streams into which the data is split. 

The non real time source stream of data from one 
of the slide scanner4, the film scanner 8 or the video 
data mixer 14 is fed to a respective data splitter 20. 
The split streams of data from the data splitter 20 take 
the form of a multiplexed stream of data comprising 
a sequence of contemporaneous portions of each of 
the split streams, e.g. the image data from a single 
frame may be split into four separate streams which 
are then output in sequence from the data splitter 20. 
The non real time multiplexed data streams from the 
data splitter 20 are recorded on a high definition dig- 
ital video tape recorder 22. In the case of the super 
high resolution camera 16 and the super high resolu- 
tion digital video tape recorder 18, the super high re- 
solution digital video tape recorder captures the im- 



age data in real time but plays it back through the data 
splitter 20 in non real time. 

The split data is then fed to a post production 

5 processing unit 24. This post production processing 
unit can be a standard piece of high definition equip- 
ment such as a high definition video effects unit or 
high definition filtering system. Alternatively, in some 
embodiments the manipulation being performed 

10 could be the storage on magnetic media by the high 
definition digital video tape recorder 22. 

The output from the post production processing 
unit 24 is fed to a further high definition digital video 
tape recorder 26 via which it is passed to a data com- 

15 biner 28. The data combiner 28 combines the split 
streams of data into an output stream of data. This can 
then be passed through a super high resolution film 
transfer unit 30 onto a 70mm film projection system 
32 or direct to a super high resolution video channel 

20 34. Alternatively, the combined output stream of data 
could be split again with accompanying pan/scan- 
/zoom operations by a video down conversion system 
36 and then displayed via a standard high definition 
channel 38 or placed onto 35mm film by an electron 

25 beam recorder 40. 

Figure 2 shows a system for the real time manip- 
ulation of image data. The difference between this 
system and that of Figure 1 is that between the data 
splitters 20 and the data combiners 28 there exists a 

30 multi channel architecture comprising four post pro- 
duction processing units 24 with corresponding 
banks of high definition video tape recorders 22 and 
26. It will be appreciated that the four post production 
processing units 24 must have a coordinated opera- 

35 tion and so a controller 42 is provided to synchronise 
their operation. For example, if the post production 
processing unit is performing a fade or wipe operation 
then it is important that this should progress at the 
same rate for each of the split streams of data if dis- 

40 tortion upon recombination is to be avoided. 

Figure 3 illustrates a super high resolution frame 
of video data. This is approximately four times the re- 
solution of current high definition video (two times 
horizontal and two times vertical) and has 2007 hor- 

45 izontal lines each composed of 3840 pixels. 

Figure 4 illustrates how the super high resolution 
frame of Figure 3 may be split into four two dimension- 
al spatial frequency sub bands. In this example, the 
image is split into low and high frequency components 

50 both horizontally and vertically. Sub band 44 is the 
low horizontal and low vertical frequency component. 
Sub band 46 is the low horizontal and high vertical fre- 
quency component. Sub band 48 is the high horizon- 
tal and low vertical frequency component. Sub band 

55 50 is the high horizontal and high vertical frequency 
component. It will be appreciated that since the super 
high resolution frame of Figure 3 has essentially dou- 
ble the horizontal and vertical spatial frequency of a 
standard high definition video frame, the splitting by 



4 



7 



EP 0 570 092 A1 



8 



a factor of four will mean that the sub band 44 in fact 
represents a high definition base band image. Sub 
band 52 is the first sub band of the next frame of im- 
age data. 5 

Figure 5 illustrates a data splitter 20 for sub band 
splitting. The super high resolution source stream of 
data is fed into a filter bank 54. In the case of non real 
time system, this data is fed in at a 1 A normal rate. The 
filter bank 54 comprises an array of finite impulse re- 10 
sponse filters of the known type for decimating and 
frequency separating the input data stream. The out- 
put from the filter bank 54 is four parallel split streams 
of data each representing a different spatial frequen- 
cy sub band. In the case of the real time system of Fig- 15 
ure 2, these split streams of data are fed in parallel to 
the multi channel post production processing system. 
In the case of the non real time system they are fed 
to a buffer and selector unit 56 where they are collect- 
ed and sequentially fed onto the single high definition 20 
video channel for post production processing with the 
system of Figure 1. 

Figure 6 shows a data combiner 28 for use with 
split streams of data produced with the sub band split- 
ting technique. In a real time system the split streams 25 
of data are fed in parallel to a filter bank 58 where they 
are combined and interpolated into a super high reso- 
lution signal. For the real time system the parallel 
channels pass through a selector and buffer unit 60 
without modification. In the case of a non real time 30 
system the multiplexed split streams of data are fed 
via a sequential channel to the selector and buffer unit 
60 where they are fed into appropriate buffer stores 
for subsequent parallel output to the filter bank 58 
during the next frame period whilst another set of buf- 35 
fers are receiving the split streams forthat next frame. 

Figure 7 illustrates the splitting of a super high re- 
solution frame with a tiling splitting technique. Differ- 
ent portions of the image A1, A2, A3 and A4 are 
formed in respective quadrants. It will be seen that 40 
these quadrants overlap. This overlapping is to facil- 
itate the removal of edge effect distortions when the 
quadrants are subsequently recombined. 

Figure 8 illustrates the split streams of data 
formed with this tiling splitting technique. Each 45 
stream of data represents a respective quadrant from 
within the super high resolution frame of Figure 7. 
Quadrant B1 represents the upper left hand quadrant 
of the subsequent super high resolution frame. 

Figure 9 illustrates a non real time data splitter 20 so 
for use with either tiling or sub sampling splitting. The 
super high resolution data is fed to a swing buffer ar- 
rangement 62. Respective frames of the super high 
resolution data are stored in respective frame stores 
on either side of the swing buffer 62. A timing circuit 55 
64 extracts the timing and synchronisation informa- 
tion from the super high resolution signal. This timing 
circuit controls the operation of a read address gen- 
erator 66 and a write address generator 68. The read 



address generator 66 and the write address genera- 
tor 68 can comprise incrementing counters address- 
ing appropriately programmed PROMs for mapping 
the incrementing count into a predetermined se- 
quence of addresses within the frame stores of the 
swing buffer 62. Whilst a current frame of super high 
resolution data is being fed into one of the frame 
stores under control of the write address generator 
68, the data from the previous frame is being read out 
of the other frame store under control of the read ad- 
dress generator 66. 

It will be appreciated that with appropriate pro- 
gramming of the PROMs the data can be read into the 
frame stores in its normal raster scan pattern but read 
out in any sequence and order that is desired. For ex- 
ample, the data can be read out as four raster scan- 
ned quadrants in the case of tiling splitting or in a ras- 
ter scanned spatially sub sampled sequence in the 
case of sub sampling splitting as will be discussed lat- 
er. 

A select and control unit 70 responsive to the re- 
spective read and write addresses is used to supply 
the appropriate signals to the control inputs of the 
frame stores and to an output selector 72. 

Figure 1 0 illustrates a real time version of the data 
splitter of Figure 9. In this case four parallel swing buf- 
fers are provided. The splitting can take place on eith- 
er the input side or output side of the frame stores. 
The full image could be written into each frame store 
and then the appropriate pixels thereof read out un- 
der control of the predetermined sequence of read 
addresses. Alternatively, only those pixels for a par- 
ticular split data stream could be read into each of the 
frame stores and then all of these read out in parallel 
with a simple incrementing read address. 

Figure 11 illustrates a sub sampling splitting tech- 
nique. The pixels from a small section of a super high 
resolution frame are shown in magnified schematic 
form at the bottom of Figure 11 . The pixels for the re- 
spective split streams of data are shown as °, A, V, 
and □. It will be seen that the pixels forming each of 
the split streams of data effectively sub sample the 
full super high resolution frame in a regular array. 

Figure 12 shows the split streams of data collect- 
ed together. Respective split streams comprise all the 
°, A, V and □ pixels from one super high resolution 
frame. 

It will be understood that the data splitters of Fig- 
ures 9 and 10 can be readily adapted by an appropri- 
ate address mapping in the address generators 66, 
68 to perform the sub sampling of Figures 11 and 12 
rather than the tiling of the previous splitting techni- 
que. 

Figure 13 illustrates a manipulation means for 
manipulating a foreground image and keying it into a 
background image. A data splitter 92 splits the fore- 
ground image data stream into a series of consecutive 
sub band image as shown in Figure 4 (sub band split- 
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ting is, in this embodiment, used as the uniform data 
exchange format between manipulation apparatus). 
These sub band images as then stored on a video 
tape recorder 94. It is desired that the foreground im- 
age be scaled prior to combination with the back- 
ground image. This scaling will alter the spatial fre- 
quencies within the image and accordingly cannot be 
carried out in the sub band domain. To overcome this, 
a reformatter 96 converts the data from a sub band 
format to a tiled format as illustrated in Figure 7. The 
output from the reformatter 96 is then scaled in the 
digital multiple effects unit 98 prior to being reformat- 
ted back into sub band format by the reformatter 100. 

On a second channel, a background image is split 
into sub band format by a data splitter 1 02 prior to be- 
ing stored on a video tape recorder 1 04. The outputs 
from the reformatter 100 and the video tape recorder 
104 are fed to the inputs of a keyer 106 where they 
are keyed together in the sub band domain under the 
control of a keying signal prior to being combined into 
an output data stream by a data combiner 108. 

A monitor 110 is provided to read the LowH, LowV 
sub band (see Figure 4) so as to provide feedback to 
the operator as to the results of the DME scaling and 
keying manipulations. 

It will be appreciated that the reformatted 96, 
100 can be constructed using the data splitters and 
data combiners described above in relation to Figures 
5, 6, 9 and 10. The reformatter 96 (sub band to tiled) 
can be formed as a sub band combiner in series with 
a tiling splitter and the reformatter 100 (tiled to sub 
band) as a tiling combiner in series with a sub band 
splitter. 

Figure 14 illustrates the monitoring of non real 
time sub band split data. The sequential stream of 
multiplexed sub band data is selectively sampled into 
a frame store 74. The sync input to the frame store 74 
ensures that it is the low frequency horizontal and low 
frequency vertical sub band data that is captured in 
the frame store 74. This particular sub band, as pre- 
viously mentioned, represents a base band high def- 
inition video signal that can be directly used to drive 
a standard high definition monitor 76. 

Figure 15 illustrates monitoring in a real time sub 
band splitting system. In this system the low frequen- 
cy horizontal and low frequency vertical sub band 
data be can directly tapped to a high definition monitor 
78 with no need for the buffering of the frame store 
74 from the non real time system. 

Figure 16 illustrates monitoring in a non real time 
tiling splitting system. Successive quadrants of a 
source image frame are captured in a frame store 80. 
This captured data is then refiltered to remove any 
edge effects and decimated down to a high definition 
signal which can then be used to drive a high defini- 
tion monitor 82. 

Figure 17 shows monitoring in a real time tiling 
splitting system. In this case the quadrants are cap- 



tured in parallel, but otherwise the steps of combina- 
tion, refiltering and decimation are the same. 

Figures 18 and 19 respectively illustrate non real 
5 time and real time monitoring in a sub sampling split- 
ting system. These monitoring systems are substan- 
tially the same as those of Figures 15 and 16 other 
than the data is in a different order within each split 
stream. 

10 Figures 20, 21 and 22 illustrate possible post pro- 

duction manipulations that may be performed. All the 
images are of a super high resolution format of the 
form illustrated in Figure 3. Figure 19 has a back- 
ground 83 formed of an expanded and defocused 

15 high definition image with a foreground image 84 sub- 
sequently matted on at its full super high resolution. 

Figure 21 shows a super high resolution back- 
ground 86 with a high definition foreground 88 matted 
on at its full high definition resolution. 

20 Figure 22 shows a high definition image that has 

been magnified horizontally and vertically to fill a full 
super high resolution frame 90. 



25 Claims 

1 . Apparatus for processing image data, said appa- 
ratus comprising: 

an image data source (2, 6, 10, 16)forgen- 
30 erating a source stream of data representing an 

image; 

a data splitter (20) for splitting said source 
stream of data into a plurality of split streams of 
data (A1, A2, A3, A4; 44, 46, 48, 50) each repre- 

35 senting a part of the information content of said 

source stream of data; 

manipulation means (24, 98) for perform- 
ing a manipulation upon said plurality of split 
streams of data; and 

40 a data combiner (28) for combining said 

plurality of split streams of data into an output 
stream of data; wherein 

said manipulation means includes at least 
one reformatter (96, 100) for reformatting said 

45 plurality of split streams of data such that the in- 

formation content of said source stream of data is 
split between said plurality of split streams ac- 
cording to a different technique that is matched to 
a manipulation to be applied to said plurality of 

so split data streams. 

2. Apparatus as claimed in claim 1, wherein said 
manipulation means (98) includes a first refor- 
matter (96) at its input and a second reformatter 

55 (100) at its output. 

3. Apparatus as claimed in any one of claims 1 or 2, 
wherein said data splitter (20) includes means for 
splitting said source stream of data into a plurality 
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of streams of two dimensional spatial frequency 
sub band data (44, 46, 48, 50) and said data com- 
biner (28) includes means for combining said 
plurality of streams of two dimensional spatial fre- 
quency sub band data to form said output stream 
of data. 

4. Apparatus as claimed in claim 3, wherein said 
manipulation means includes an image data re- 
corder (22) for separately recording said plurality 
of streams of two dimensional spatial frequency 
sub band data and monitor means (110) for repro- 
ducing a monitor image during partial replay from 
that stream of two dimensional sub band data 
(44) having the lowest two dimensional spatial 
frequencies. 

5. Apparatus as claimed in any one of claims 3 or 4, 
wherein said data splitter (20) is operable to pro- 
vide that stream of two dimensional sub band 
data having the lowest two dimensional spatial 
frequencies (44) with a signal format suitable for 
direct reproduction by a television receiver. 

6. Apparatus as claimed in anyone of the preceding 
claims, wherein said at least one reformatter (96, 
100) includes means for reformatting said plural- 
ity of split streams of data into a plurality of 
streams of data (A1 , A2, A3, A4) each represent- 
ing a different area within an image. 

7. Apparatus as claimed in claim 6, wherein said 
manipulation means (24, 98) includes a spatial fil- 
tering means for performing spatial filtering sep- 
arately upon said plurality of streams of data rep- 
resenting different areas of an image. 

8. Apparatus as claimed in any one of the preceding 
claims, wherein said at least one reformatter (96, 
100) includes means for reformatting said plural- 
ity of split streams of data into a plurality of 
streams of sub sampled data (A°, AA, AV, An). 

9. Apparatus as claimed in any one of the preceding 
claims, wherein said manipulation means has a 
multichannel architecture with said plurality of 
split streams of data each being manipulated in a 
different channel so as to provide real time ma- 
nipulation of said image data. 



11. Amethod of processing image data, said method 
comprising the steps of: 

generating a source stream of data repre- 
5 senting an image; 

splitting said source stream of data into a 
plurality of split streams of data each represent- 
ing a part of the information content of said 
source stream of data; 
10 reformatting said plurality of split streams 

of data such that the information content of said 
source stream of data is split between said plur- 
ality of split streams of data according to a differ- 
ent technique that is matched to a subsequent 
15 manipulation ; 

performing a manipulation upon said plur- 
ality of split streams of data; and 

combining said plurality of split streams of 
data into an output stream of data. 

20 



10. Apparatus as claimed in anyone of the preceding 
claims, wherein said data splitter outputs a multi- 
plexed stream of data comprising a sequence of 
contemporaneous portions of said plurality of 55 
split streams of data, said manipulation means 
performing non real time manipulation upon said 
multiplexed stream of data. 
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